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BACKGROUND OF THE INVENTION 
[Field of the Invention] 

This Invention relates to an Image processing 
device and an Image processing method to perform 
Image conversion. Image enhancement, and the like by 
carrying out a predetermined processing to a two- 
dimensional Image. 

[Description of the Related Art] 

Conventionally, Image conversion. Image 
enhancement, and other processing of a two- 
dimensional Image are performed In such a manner that, 
for each pixel, data of a plurality of pixels 
surrounding that pixel are processed one by one. 

Specifically, as shown In Fig. 7, each of the 
large number of pixels 101 arranged In the form of 
matrix corresponding to a two-dimensional image, for 
example, data Xi to Xs of eight neighboring pixels 102 
surrounding a pixel 101 and datum Xq of the pixel 101 
Itself, within a kernel block, are corresponded to 
and multiplied by respective coefficients Aq to Aq , 
and a sum of AoXo'i-AiXi + ...+A8X8 , is obtained as a 
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processing data of the pixel 101. The above series 
of operations are performed for each of all necessary 
pixels by shifting the kernel to each pixel. 

However, the above - described Image processing 
method. In which computation processing Is performed 
for each of all necessary pixels, results In 
extremely large volume of computations and extremely 
high computational burden and power consumption. 
More specifically. In each time the computation 
processing Is performed, a necessary pixel data has 
to be transferred from a memory to a processor, and 
all data on the plural neighboring pixels In the 
kernel have to be downloaded. In addition, when the 
kernel scans throughout the two-dimensional Image, 
the same pixel Is repeatedly accessed, which Is a 
serious problem. 

SUMMARY OF THE INVENTION 
In order to solve the above - described problems, 
the present Invention Is achieved, aiming at 
providing an Image processing device and an Image 
processing method to allow Image processing without 
loss using relatively simple combination of equipment. 
In an extremely short time, and with low power 
consumption . 

As a result of the committed Investigation, the 
Inventors have attained following embodiments of the 
present Invention . 
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The Image processing device according to the 
present Invention multiplies two-dimensional pixel 
data by a matrix of coefficients, and based on a sum 
of the multiplied results, filters the pixel data. 
The Image processing device at least Includes: a 
memory unit array In which a matrix of plural memory 
units are arranged, each memory unit having at least 
a first memory cell, a second memory cell, and a 
third memory cell to store the above pixel data; 
first calculators arranged In the number of columns 
of, and In rows of, the memory unit array, to obtain 
a first processing data which Is obtained by 
performing computational processing for the pixel 
data of a certain column In the memory unit array and 
stored In the second memory cell; and a second 
calculator arranged In the number of rows of, and In 
columns of, the memory unit array, to obtain a second 
processing data by performing computational 
processing for the pixel data of a certain row In the 
memory unit array and stored In the third memory cell. 
The Image processing unit carries out the filtering 
based on a computed result obtained by the second 
calculator . 

An Image processing method according to the 
present Invention Is an Image processing method for 
the Image processing device Including the memory unit 
array In which a plurality memory units to store the 
pixel data are arranged In a form of matrix, the 
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first calculators which are arranged In the number of 
columns of, and In rows of, the memory unit array, 
and the second calculators which are arranged In the 
number of rows of, and In columns of, the memory unit 
array. The Image processing method Includes a first 
step to obtain the first processing data by 
performing computational processing for the pixel 
data In a certain column of the memory unit array, 
and store the first processing data In the second 
memory cell which Is Independent from the first 
memory cell storing the pixel data In the memory unit, 
and a second step to obtain the second processing 
data by performing a computational processing for the 
first processing data In a certain row of the memory 
unit, and store the second processing data In the 
third memory cell In the memory unit • 

BRIEF DESCRIPTION OF THE DRAWINGS. 

Fig. 1 is a diagrammatic view of an Image 
processing device according to a present embodiment; 

Figs. 2A and 2B are diagrammatic views of an 
Image processing method according to the present 
embodiment ; 

Fig. 3 Is a diagrammatic view showing a flow of 
computational processing In a row computation 
section ; 

Fig. 4 Illustrates a processing method In a 
Laplaclan filter; 



Fig. 5 is an equivalent circuit diagram of each 
memory cell in a memory unit; 

Fig. 6 is a diagram of an equivalent circuit of 
the row computation section and a column computation 
section; and 

Fig. 7 is a diagrammatic view showing a 
conventional image processing method. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Fig. 1 is a schematic block diagram showing an 
image processing device in the present embodiment. 

The image processing device includes a memory 
unit array 100 in which memory units 10 having a 
plurality of memory cells are arranged in a form of 
matrix, a row selecting section 200 to select a row 
in the memory unit array 100 from which data is read 
out, a column selecting section 300 to select a 
column in the memory unit array 100 from which data 
is read out, a row computing unit 400 to perform 
computation of the data in the memory unit 10 
selected in the row selecting section 200, and a 
column computing unit 500 to perform computation of 
the data in the memory unit 100 selected in the 
column selecting section 300. 

Further, the row computing unit 400 includes row 
computing sections 40 in the number of columns 
provided by corresponding to respective columns in 
the memory unit array 100, in a manner to allow 
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paratactlc computation of data from memory units 10 
In each row. Similarly, the column computing unit 
500 Includes column computing sections 50 In the 
number of rows provided by corresponding to 
respective rows In the memory unit array 100, In a 
manner to allow paratactlc computation of data from 
memory units 10 In each column. 

The memory unit 10 at least Includes, In addition 
to a first memory cell to store pixel data, a second 
memory cell to istoire a first processing data obtained 
by computation In the row computing unit 400, and a 
third memory cell to store a second processing data 
obtained by computation In the column computing unit 
500 . 

The Image processing device In the present 
embodiment combines, upon computation using a matrix 
of kernel, a computed result In columns and a 
computed result In rows. By storing the computed 
results respectively In the first and the second 
memory cells of the memory unit 10, there Is no need 
to perform computation of each of all necessary 
pixels . 

Figs. 2A and 2B are diagrammatic views showing an 
Image processing method In the present embodiment. 
As an example of filtering, a smoothlng-processlng- 
case Is explained below. In which all coefficients 
forming a 3x3 kernel are "1". 
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In Fig. 2A, pixel data stored in the memory units 
10 in a row selected in the row selecting section 200 
are sequentially read out to the row computing unit 
400. Here, each row computing unit 40 performs 
predetermined computation of three-row pixel data 
including a middle row selected in the row selecting 
section 200, and rows above and below that middle row. 

Fig. 3 is a diagrammatic view showing a flow of 
computational processing in the row computing section 
40 . 

Each memory unit 10 is connected in columns 
through a column bus 5, and in rows through a row bus 
6 • 

The pixel data stored in the first memory cells 1 
are added up as electric current value through the 
column bus 5 and inputted to the row computing 
section 40. In the row computing section 40, a 
computed result obtained by trisecting the total 
value of the three pixel data in the first memory 
cells 1 each are stored in the second memory cell 2 
in the memory units 10 in the middle row. 

Subsequently, as shown in Fig. 2B, the first 
processing data stored in the second memory cell 2 in 
the memory units 10 in the column selected by the 
column selecting section 300 are sequentially read 
out to the column computing unit 500. Here, each 
column computing section 50 performs predetermined 
computation of three-column pixel data including the 



middle column which Is the column selected In the 
column selecting section 300, and columns on the left 
and the right thereof. 

More specifically, the first processing data 
stored in the second memory cell 2 of the three 
memory units 10 in the middle row shown in Fig. 3 are 
respectively added up as electric current value 
through the row bus 6, and inputted to the column 
computing section 50. In the column computing 
section 50, the computed result obtained by 
trisecting the total value of the three first 
processing data of the second memory cells 2 is 
stored in the third memory cell 3 in the memory units 
10 in the middle column. 

By performing the above - described processing, the 
mean value of the pixel data in nine memory units 10 
shown in Fig. 3 is stored in the third memory cell 3. 

By performing computation for all the rows in the 
memory unit array 100 by each row computing section 
40 of the row computing unit 400, storing the 
computed results in the memory cell 2 in each memory 
unit 10, and further performing computation for all 
the columns in the memory unit array 100 by each 
column computing section 50 of the column computing 
unit 500, the computed results are stored in the 
third memory cell 3 of each of all the memory units 
10 . 
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As described above. In the memory unit array 100, 
computed results In the row computing section 40 and 
the column computing section 50 respectively are 
stored In each memory cell of the memory units 10, 
and by combining the computed results, a complex 
filtering such as the Laplaclan filter shown In Fig. 
4 can be realized. Further, when computation In rows 
and columns of the memory unit array 100 Is performed 
In plural times, the computed result can be stored In 
a fourth memory cell. 

Fig. 5 Is an equivalent circuit diagram of each 
memory cell In a memory unit 10. 

As shown In Fig. 5, each memory cell Is composed 
of six transistors (Ml to M6 ) . Each memory cell Is 
provided with two ports, a read/write port (I/O port) 
and a read-out port (Output port), each of which Is 
connected to either one of the column bus 5 and the 
row bus 6 shown In Fig. 3. Here, among the four 
memory cells In the memory unit 10, In two cells the 
read/write port Is connected to column bus 5, and In 
the remaining two cells the read/write port Is 
connected to the row bus 6. 

In the case of writing, the transistors M3 , M4 , 
and M5 are turned on such that the total value of the 
electric current flowing In the transistors Ml and M2 
Is the pixel data. Further, the transistors M2 and 
M4 are provided so as to compensate so-called "clock- 
field- through " . 
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Fig. 6 Is an equivalent circuit diagram of the 
row computing section 40 and the column computing 
section . 50 . 

Each computing section Includes an accumulation 
circuit, and a multiplying/dividing circuit. 

The multiplying circuit Is basically a current 
mirror circuit, and expansion of the gate width of 
the output-side transistor by one time, twice, or 
four times, allows multiplication by constant values 
of one to seven times. Further, the circuit 
configuration Is such that provision of a switch 
between the accumulation circuit and an output/Input 
terminal allows simultaneous multiplication up to one 
to 1/7 times . 

As has been explained, with the present 
embodiment, the one-dlmenslonal computation In rows 
and In columns of the memory unit array 100 does not 
require a vast volume of computation processing or 
repeated accesses to a same pixel, so that 
computation of extremely high efficiency can be 
performed • 

Hence, according to the present embodiment, the 
Image processing device and the Image processing 
method, allowing Image processing without loss using 
relatively simple combination of equipment. In an 
extremely short time, and with low power consumption, 
can be provided. 
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The present embodiments are to be considered In 
all respects as Illustrative and no restrictive, and 
all changes which come within the meaning and range 
of equivalency of the claims are therefore Intended 
to be embraced therein. The Invention may be 
embodied In other specific forms without departing 
from the spirit or essential characteristics thereof. 
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